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We discuss ergodicity breaking in frustrated disordered systems with no apparent broken sym¬ 
metry of the Hamiltonian and present a way how to amend it in the low-temperature phase. We 
demonstrate this phenomenon on mean-field models of spin glasses. We use replicas of the spin 
variables to test thermodynamic homogeneity of ergodic equilibrium systems. We show that replica- 
symmetry breaking reflects ergodicity breaking and is used to restore an ergodic state. We then 
present explicit asymptotic solutions for the Ising, Potts and p-spin glasses. Each of the models 
shows a different low-temperature behavior and the way the replica symmetry and ergodicity are 
broken. 
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I. INTRODUCTION 

Ergodicity is one of the most important properties of 
large statistical systems. We usually assume that macro¬ 
scopic systems in equilibrium are ergodic. Ergodicity, or 
quasi-ergodicity, means the phase trajectory comes arbi¬ 
trarily close to any point of the space allowed by macro¬ 
scopic constraints. The physically most important form 
of the ergodic theorem due to Birkhoff tells us that time 
average along the phase-space trajectory equals the sta¬ 
tistical average over the whole phase volume! 1 ' It means 
that the equilibrium state must span the whole avail¬ 
able phase space. Although the foundations of statistical 
mechanics are based on ergodicity, lack of ergodicity is 
widespread in physical phenomena.® Typical examples of 
ergodicity breaking are phase transitions with symme¬ 
try breaking. Broken ergodicity is sometimes used as a 
generalization of symmetry breaking.® Although broken 
global symmetry is always accompanied by broken er¬ 
godicity, the converse does not hold. There are systems 
that break ergodicity without any apparent symmetry 
of the Hamiltonian being broken. The typical example 
is structural glass with numerous metastable states that 
prevent the macroscopic system from reaching the true 
equilibrium on experimental time scales. 

Broken ergodicity represents an obstruction in the ap¬ 
plication of fundamental thermodynamic laws. It hence 
must be recovered. When ergodicity is broken in a phase 
transition breaking a symmetry of the Hamiltonian, one 
introduces a symmetry breaking field into the Hamilto¬ 
nian, being the Legendre conjugate to the extensive vari¬ 
able that is not conserved in the broken symmetry trans¬ 
formation in the low-temperature phase. The symmetry¬ 
breaking field allows one to circumvent the critical point 
of the symmetry-breaking phase transition and simulta¬ 
neously restores ergodicity. Systems with no broken sym¬ 
metry of the Hamiltonian at the phase transition, such as 
spin glasses or some quantum phase transitions, do not 
offer external symmetry-breaking fields and other tech¬ 
niques must be employed to find the proper portion of 
the phase space covered by the phase-space trajectory. 


In this paper we discuss the peculiarities of ergodicity 
breaking in phase transitions in frustrated disordered sys¬ 
tems described by random non-local interaction without 
any directional preference in the phase space of the fun¬ 
damental variables. We use mean-field spin-glass models 
with a Gaussian random spin-exchange and show how 
one can restore ergodicity via hierarchical replicating the 
spin variables of the original Hamiltonian. We present a 
general scheme of the real-replica method and apply it 
on mean-field Ising, Potts and p-spin glass models. The 
three generic models show different ways in which er¬ 
godicity is broken and we demonstrate on them how the 
phase space of the equilibrium state can be constructed. 
We manifest that ergodicity breaking is equivalent to the 
replica-symmetry breaking. 


II. ERGODICITY AND THERMODYNAMIC 
HOMOGENEITY 

Birkhoff ergodic theorem allows one to introduce equal 
a priori probability of allowed states in the phase space. 
It is, however, nontrivial to determine in macroscopic pa¬ 
rameters which the allowed states indeed are. This is ac¬ 
tually the most difficult task in constructing the proper 
phase space in statistical models. That is, to find out 
which points of the phase space are infinitesimally close 
to the trajectory of the many-body system extended to 
infinite times. Since we never solve the equation of mo¬ 
tion of the statistical system, we have only static means 
to check validity of ergodicity. We then test consequences 
of the ergodic hypothesis on the behavior of the equilib¬ 
rium state. The most important consequence of ergodic¬ 
ity of statistical systems is the existence of the thermo¬ 
dynamic limit. 

The trajectory of the many-body system covers almost 
the whole allowed phase space. It means that the space 
covered by such trajectory does not depend on the initial 
state in non-chaotic systems. In ergodic systems then 
the thermodynamic limit does not depend on the specific 
form of the volume in which the macroscopic state is 
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confined as well as on its surrounding environment. The 
macroscopic systems can either be isolated or embedded 
in a thermal bath. The thermodynamic equilibrium, the 
equilibrium state in the thermodynamic limit, is the same 
with vanishing relative statistical fluctuations. The ther¬ 
modynamic equilibrium can then be reached by limiting 
any partial volume of the whole to infinity. The ergodic 
equilibrium state is homogeneous in the thermodynamic 
limit. 

Thermodynamic homogeneity is usually expressed via 
Euler’s lennngPl 

a S(U, V,N,..., X u ...) = S(aU, aV, aN,..., aX u ...) 

(!) 

telling us that entropy S is an extensive variable and is 
a first-order homogeneous function of all extensive vari¬ 
ables, internal energy U , volume V number of particles 
N, and model dependent other extensive variables X,. 
As a consequence of Euler’s lemma we obtain that ther¬ 
modynamic equilibrium is attained as a one-parameter 
scaling limit where we have only one independent large 
scale, extensive variable, be either volume or number of 
particles, and the other extensive variables enter thermo¬ 
dynamic potentials as volume or particle densities insen¬ 
sitive to changes of the scaling variable. 

Thermodynamic homogeneity allows us to use scal¬ 
ing of the original phase space. Thermodynamic quanti¬ 
ties remain unchanged if we arbitrarily rescale the phase 
space and then divide the resulting thermodynamic po¬ 
tential by the chosen scaling (geometric) factor. We can 
do that by scaling energy E of the equilibrium state. If 
we use a scaling factor //, that can be an arbitrary posi¬ 
tive number, then the following identities hold for entropy 
S(E) of the microcanonical and free energy F(T) of the 
canonical ensemble with energy E and temperature T, 
respectively 

S(E) = k B In T(E) = — In T{E) V = — In T(vE) , 

(2a) 

F(T) = - ^ In [Tr e~^ H ]" = - ^ In [Tr e~^ H ] , 

(2b) 

where we denoted T(E) the phase-space volume of the 
isolated system with energy E. 

The scaling of the phase space with an integer scal¬ 
ing factor v can be simulated by replicating //-times the 
extensive variables. That is, we use instead of a single 
phase space v replicas of the original space. The reason 
to introduce replicas of the original variables is to extend 
the space of available states in the search for the allowed 
space in equilibrium. The replicas are independent when 
introduced. We use the replicated variables to study sta¬ 
bility of the original system with respect to fluctuations 
in the thermal bath. To this purpose we break indepen¬ 
dence of the replica variables by switching on a (homoge¬ 
neous) infinitesimal interaction between the replicas that 
we denote /i ab . We then add a small interacting part 


A H(n) = Yi lYa<b l-L ab X'lX l { to the replicated Hamilto¬ 
nian with dynamical variables X, . The original system is 
then stable with respect to fluctuations in the bath, rep¬ 
resented by the interaction with the replicated variables, 
if the linear response to perturbation /z is not broken. If 
the linear response holds then the perturbed free energy 
per replica relaxes, after switching perturbation /z off, to 
the original one in the thermodynamic limit 

—/3F v (n) = i In Tr„ exp < -/3 H a - ft AH (/z) 

l a—l 

- > InTrexp{— j3H} , (3) 


where Tr„ refers to trace in the //-times replicated phase 
space. If the linear response to the inter-replica inter¬ 
action does not hold, the thermodynamic limit of the 
original system is not uniquely defined and depends on 
properties of the thermal bath. If there are no appar¬ 
ent physical fields breaking the symmetry of the Hamil¬ 
tonian, the phase-space scaling represented by replicas 
of the dynamical variables introduces shadow or auxil¬ 
iary symmetry-breaking fields, inter-replica interactions 
/z ab > 0. They induce new order parameters in the re¬ 
sponse of the system to these fields that need not vanish 
in the low-temperature phase, when the linear response 
breaks down. They offer a way to disclose a degeneracy 
when the thermodynamic limit is not uniquely defined 
by a single extensive scale and densities of the other ex¬ 
tensive variables. The inter-replica interactions are not 
measurable and hence to restore the physical situation 
we have to switch off these fields at the end. If the sys¬ 
tem is thermodynamically homogeneous we must fulfill 
the following identity 


d 

dv 


lim F v {n) 

[ A —>-0 


= 0 


( 4 ) 


for arbitrary //. This quantification of thermodynamic 
homogeneity, thermodynamic independence of the scal¬ 
ing parameter //, will lead us in the construction of a 
stable solution of mean-field spin glass models. To use 
equation ( 4]) in the replica approach we will need to con¬ 
tinue analytically the replica-dependent free energy to 
arbitrary positive scaling factors // € R + . Specific as¬ 
sumptions on the symmetry of matrix \i ah will have to 
be introduced. It is evident from Eq. © that the linear 
response to inter-replica interaction can be broken only 
if the replicas are mixed in the //-times replicated free 
energy F v . 


III. FRUSTRATED DISORDERED SYSTEMS - 
MEAN-FIELD SPIN-GLASS MODELS 

We present models on which the replica approach to 
the construction of the equilibrium state proves efficient. 
The linear response to a small inter-replica interaction 
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may be broken only if replicas are intermingled in ther¬ 
modynamic potentials. Mixing of replicas is achieved by 
randomness of an inter-particle interaction. We use lat¬ 
tice spin models with random spin-exchange to study 
replica mixing thermodynamic potentials. To simplify 
the reasoning we resort to mean-field models with no ex¬ 
plicit spatial coherence. The mean-field approximations 
of lattice systems can either be introduced as models 
on fully connected graphs, models with long-range in¬ 
teraction, or as the limit to infinite spatial dimensions on 
hyper-cubic lattices. Thereby a scaling of the inter-site 
interactions is needed so that to keep the energy an ex¬ 
tensive variable, linearly proportional to the volume as 
demanded by Eq. |l]). 


A. Ising spin glass 

The simplest lattice spin system consists of spins with 
the lowest value h/2 where only their projection to the 
easy axis enters interaction. We set in this paper H = 
1 ,ks = 1. The spins can then be treated classically with 
projections S t = ±1. The resulting Hamiltonian of the 
Ising model reads 

H [J, S] = Y, J ij S i S j +hY J S i . (5) 

i<j i 

To obtain a glassy behavior we introduce a randomness 
into spin exchange Jij. We will explicitly consider only 
the mean-field version of this model with a Gaussian dis¬ 
tribution of the spin-exchange. The energy remains an 
extensive variable if we rescale the (long-range) interac¬ 
tion in the man-field limit as follows 

N N 

N ( Jij) av = = N (Jij)av = = ^ ’ 

j=i i =1 

where N is the number of lattice sites. 


B. Potts glass 

The p-state Potts model is a generalization of the Ising 
model to p > 2 spin components. The original formula¬ 
tion of Potts 5 with Hamiltonian H p = — Jij^n it no¬ 
where Hi = 0,... ,p — 1 is an admissible value of the p- 
state model on the lattice site R,, is unsuitable for prac¬ 
tical calculations. The Potts Hamiltonian can, however, 
be represented via interacting spins®! 


their scalar product 

p p 

e A = 0 I e A e A = P & af> > e A e B =P$AB- 1 

A=1 A—1 

(7a) 

for a € {1, ...,p — 1}. We use the Einstein summation 
convention for repeating Greek indices of the vector com¬ 
ponents indicating a scalar product of the Potts vectors. 
Using these properties we can construct an explicit rep¬ 
resentation of the Potts spin vectors 

{ 0 A < a 

Si A =° (7t) 

a >«- 

Potts model shows a glassy behavior if we introduce 
randomness in spin exchange J\j . In the mean-field limit 
we chose the following Gaussian distribution 

P(J )= _ - _exp ~( Jij ~ J °^ (8) 

1 lJ> (2nJ 2 /N) 1 / 2 P 2J 2 /N ’ U 

where Jo = V -1 JY Joj is the averaged (ferromagnetic) 
interaction. 


C. p-spin glass 


Potts model is not the only interesting extension of 
the Ising model. Another generalization is the so-called 
p-spin model. It describes a system of Ising spins where 
the spin exchange connects a cluster of p spins. The 
Hamiltonian of such a model reads 

H p [J, S] = £ Ji li2 ...i v S n S l2 ...Si,. (9) 

l<ii<i 2 <...<i p 


Randomness in the spin exchange is again taken Gaussian 
so that the energy is an extensive variable in the large 
volume limit N —» ooP 


P {J ili 2 ...i p ) = 


I Np - 1 

7T p\ 


exp 


Ji li 2 ...i P 2 iV p - 1 


J 2 p! 


This model is interesting in that we can analytically 
study the limit p —► oo for which we know an exact 
solution.^ 


IV. ERGODICITY AND REPLICA-SYMMETRY 
BREAKING 


Hp [J, S] = 4 E ' Sj - £ h • S, , ( 6 ) 

i,j i 

where S, = (s),... sf -1 } are Potts vector variables tak¬ 
ing values from a set of state vectors {e^}^ =1 . Functions 
on vectors are in equilibrium fully defined through 


Randomness in the spin exchange causes mixing of 
replicas of the spin variables. Frustration prevents selec¬ 
tion of easy axes, even if inhomogeneously distributed, 
that could select kind of regular spin ordering. The spin- 
glass models do not provide us with apparent symmetry¬ 
breaking fields that could stabilize the low-temperature 
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glassy phase. There is, nevertheless, an ordered low- 
temperature phase with order parameters to be found. 
The determination of the proper phase space of homo¬ 
geneous order parameters is the most difficult part in 
the search for the true equilibrium state in the spin-glass 
models. Replicas proved to be the only available means 
for reaching this goal. 


A. Annealed and quenched disorder 


sum. The only difference is that there is no limit to 
zero number of replicas for the annealed randomness. In¬ 
stead, independence of the replica index is demanded. 
The annealed and quenched free energies can then be 
represented in the ^-times replicated phase space: 


pF an = 

P F qu = 


-lim In (Zm) 

V N->oo c 


— lim 




(lla) 

(lib) 


Randomness in the spin exchange, introduced in 
Sec. |III[ causes mixing of replicas and may lead to break¬ 
ing of ergodicity manifested in a replica-symmetry break¬ 
ing. We can, however, treat the disorder either dynam¬ 
ically or statically. That is, we can prepare the system 
so that the random configurations are thermally equi¬ 
librated, annealed disorder, and contribute to a single 
equilibrium state. In this situation we average over ran¬ 
dom configurations of the partition sum. If we have v 
replicas of the spin variables we have to calculate the 
following configurationally averaged partition function 

.. V N 

(z v N ) av =/ 

^ a= 1 i= 1 

xexp j-/?^>[J,S a ]j , (10a) 

where /r(J) and p( S) are distribution functions for the 
spin exchange and spins, respectively. Or we can cool 
the macroscopic system down very fast so that there is 
not enough relaxation time to reach the low-temperature 
equilibrium, quenched disorder, and we have to average 
thermodynamic potentials in the thermodynamic limit, 
e. g. free energy, 


~P{F v N ) av 


N 


D[j\p[j\\n / nn«ws?i 

J a—l i— 1 

x exp | —/3 X>[J,S“]1 . (10b) 


a—l 


What is common for both cases is that we have to con¬ 
tinue analytically the free energy of the replicated system 
to arbitrary positive multiplication factor v. Either to 
test quantitatively thermodynamic homogeneity, Eq. Q , 
or to perform the limit v —>■ 0 non-perturbatively. 


B. Replica-symmetry breaking 


To find the equilibrium state for the spin glass mod¬ 
els we will test validity of the linear-response to a small 
inter-replica interaction. Although ergodicity of the 
original model may be broken, we expect that it will 
be restored in an appropriately replicated space. The 
inter-replica interaction generates new order parameters 
X ab = (( S a S b ) T )av - q that will not vanish if ergodicity, 
replica-symmetry is broken. We denoted q = ((S^^av 
that is the order parameter in the non-replicated (en¬ 
larged) space. A i/-times replicated free energy density 
of the Ising spin glass (quenched disorder) in the mean- 
field limit can be represented ;u- : 1 

lj2{{x ab ) 2 + 2qX ab }-(l-q) 2 

a^b 

p= e -7?2 / 2 In Tr exp j /3 2 J 2 x ab S'°S' b 

^ V a<b 

v 

+/3h sa 

a—l 




—oo 


Spin glasses are assumed to be quen ched, hence averaging 
over spin couplings from Eq. (10b) is to be used. 

From the mathematical point of view it is much more 
complicated to evaluate the quenched averaging, since 
logarithm is difficult to handle. Edwards and Anderson 10 
introduced the replica trick, In a; = lim^^o (% n ~ 1) / n 
to convert quenched into the annealed averaging. The 
replica trick was originally the reason to introduce repli¬ 
cas. Hence, to distinguish the replicas from the replica 
trick from those testing thermodynamic homogeneity, we 
call the former mathematical replicas and the latter real 
replicas. 

At the end, there is no big difference in the annealed 
and quenched randomness when using replicated vari¬ 
ables. In both cases we average a replicated partition 


where we denoted the fluctuating magnetic field h = 
h + rjy/q- Before we investigate validity of he linear re¬ 
sponse, we analytically continue the expression for the 
free energy to arbitrary (non-integer) positive replication 
indices v G M + . Parisi found restrictions on the symme¬ 
try of the matrix of overlap susceptibilities Xab to make 
/„ an analytic function of v JUKI] They are 

x aa = o , x ab = x ba , E(x ac -x 6c ) =0 • ( 13 ) 

C=1 

These restrictions reduce the number of independent 
overlap susceptibilities to K < v. Let each indepen¬ 
dent susceptibility xi have multiplicity mj. Parame¬ 
ters mi must be divisors of v and obey a sum rule 
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FIG. 1: Matrix of overlap susceptibilities Xab for v = 8 and 
with three levels (hierarchies) of symmetry breaking K = 3 
exemplifying the structure allowing for analytic continuation 
to arbitrary positive v. 


v = 1 + Eil i m i- We generally denote K the number of 
independent values of overlap susceptibility Xab ■ An ex¬ 
ample of such a matrix for v = 8, K = 3 and mi = 2 l ~ 1 
is illustrated in Fig. |T] It is now straightforward to cal¬ 
culate free energy for matrices \ab fulfilling criteria (131. 
We obtain 


K 


fK(q,{x};{™}) = -j(l~ <?) 2 + ~ TO «-i)» 


1 = 1 


x(2« + »)+ 2 Xi 


d " e -Vu„ 


dXx \ 2 

-r=e~ x * 

V2tt 


/2 


J — oo V 27T 


e Al ^ 2 {2 cosh [0 (h 


K 


+vVv + ^2 Xi a Jxi - Xi +1 


i=i 


ipj 

m K /m K —x~ 

1 

Jj J 



(14a) 


with x/c+i = 0 and m o = 1. It may appear convenient 
to rewrite the free-energy density to another equivalent 
form 


fx(q; Axi,..., Axk.toi, ... ,TOif) = -- (1 - q— 
^2 A X^] -^ ln 2 +jE ffl|A XI 2^ + ^Axi 


Z=1 


Z=1 


i=l 


1 r 00 

-Ay,] - w / X>ry In 
P J — OO 




(14b) 


where we ordered the parameters so that Ay; = Xz — 
Xi+i > Axi+i > 0. We further used a short-hand nota¬ 
tion for iterative partition functions 


Zi = 


VXi z™\ 


-| 1 /mi 


with an abbreviation for a Gaussian differ¬ 
ential DX = dA e _A ”/ 2 /v / 27r. The initial 
partition function for the Ising spin glass is 


Z 0 = cosh 


Free energy 


P(h + vVd + Ez=i X 

fx is an analytic function of geometric parameters mi 
that can now be arbitrary positive numbers. Equilibrium 
values of order parameters \i ■ m i hi representation (14a) 


or A Xii m i from (14b) are determined from extremal 


points of the free energy functional. 

It is clear that complexity of the solution increases 
rapidly with the increasing number of different values 
Ax*, that is, with number K of replica hierarchies. We 
give here an example of the lowest replica-symmetry 
breaking free energy (K = 1) 


h(q-,Xi,mi) = -^(1 -q- xi) 2 

0 i r 


Xbyln / VX\ 


{2 cosh \0 (h + Vy/q + Ai-y/xi)]} 


— OO 
mi 


(15) 


It has three parameters, q, Xi, m\ to be determined from 
stationarity of the free-energy functional from Eq. (15). 


It represents a free energy with the first level of ergodic- 
ity breaking or replica-symmetry breaking (1RSB). Gen¬ 
erally, free energy fx stands for ergodicity breaking on 
K levels, K generations of replicas (ATRSB). 

Free energy f K (q', A Xi,---) A Xx,m 1 ,... > m K ) con¬ 
tains 2K + 1 variational parameters, q, Ay-;, m, for i = 
1,2 ,...K that are determined from stationarity of the 
free energy with respect to small fluctuations of these pa¬ 
rameters. The replica construction introduced a new pa¬ 
rameter K that is not a priori determined. It can assume 
any integer value in the true equilibrium. The number of 
replica hierarchies is in this construction determined from 
stability conditions that restrict admissible solutions, sta¬ 
tionarity points. A solution with K levels is locally stable 
if it does not decay into a solution with K +1 hierarchies. 
A new order parameter in the next replica generation Ay 
may emerge so that Ay; > Ay > Ax( +1 for arbitrary 
l. That is, the new order parameter may peel off from 
Ay; and shifts the numeration of the order parameters 
for i > l in the existing IF-level solution. To guaran¬ 
tee that this does not happen and that the averaged free 
energy depends on no more geometric parameters than 
mi ,..., mx we have to fulfill a set of K + 1 generalized 
stability criteria that for our hierarchical solution read 
for l = 0,1,..., K 


Af = 1 — /3 2 <((l - t 2 + 


Yj mi (<*>?-! - 

m)) 

> 0 (16) 

i=0 

/1 / K' 

V 

with mo = 0 and 

formally 

(t). i = 

0. We introduced 

short-hand 

notations 


t = tanh 0 (h + q^/q + i XiV A Xi) and 
(t)l(v;X K ,...,Xi + i) = (pi... (pit)\ 1 ■ • .)a, with 

(A(AO)a, = fZo V Xi X(X t ) and Pl = Z™JJ(Z ™\) Al . 


The lowest I\ for which all stability conditions, Eq. (16), 
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are fulfilled is an allowed equilibrium state. It need not, 
however, be the true equilibrium state, since the stability 
conditions test only local stability and cannot decide 
which of several extremal points is the true ground state. 
The stability conditions, Eq. (16), are necessary for the 
system to be thermodynamically homogeneous. They 
are, however, not sufficient to guarantee global thermo¬ 
dynamic homogeneity. Note that stability conditions 
from Eq. (16) guarantee only local homogeneity, since 


they hold only for the optimal geometric parameters 
m; determined by stationarity equations. The global 
thermodynamic homogeneity, Eq. Q, would demand 
Ax > 0 for arbitrary positive uik- 


It is an implicit but closed functional equation for the 
derivative g'(x]h) on interval [0, X] for a given function 
m(x). We have to know the full dependence of this func¬ 
tion on parameter x to evaluate the free energy with 
continuous replica-symmetry breaking. It is important 
to note that free energy f(q,X;m(x)) defines a ther¬ 
modynamic theory independently of the replica method 
within which it was derived. It means that we can look 
for equilibrium states of spin-glass models without the 
necessity to go through instabilities of the discrete hier¬ 
archical replica-symmetry breaking solutions. 

Analogously we can perform the limit K —> oo with 
To; — m;_|_i = Am/K —> dm in representation Eq. (14a). 


C. Continuous limit 


We recall that to;+i < mi. We further on assume that 
Xi — X 2 > 0 is not infinitesimally small. The limiting free 
energy can then be represented as 


If free energy f K (q; Ayi,..., A xk, mi,..., m K ) is un¬ 
stable for all finite XT’s one has to perform the limit 
K —> oo. Parisi derived a continuous version of the 
infinitely times replicated system by assuming A xi = 
A x/K —t dx , and neglecting second and higher powers 
of A xi with the fixed index l. This ansatz was based on 
the analysis of the first few hierarchical solutions of the 
Ising spin glassf^^HIIl When performing the limit K —> oo 
in representation Eq. ( 14b ) the free-energy functional can 
then be represented aP^ 


f(q,X;m(x)) = ~{l -q-X) 2 - ^1 n2+^ J dx 

m(x)[q +X - x\-^(g(X,h + r]y/q)) ri (17) 

where (Xfji))^ = f^ c oc 'Dr)X(r)). This free energy is 
only implicit since its interacting part g(X , h ) can be ex¬ 
pressed only via an integral representation containing the 
solution itself 


g(X, h ) = exp 



+m(x)g'(x\ h + h)d^\ } g(h + h) 


h=0 


(18a) 


with g{h) = In [cosh jdh\. The ’’time-ordering” operator 
T x orders products of ^-dependent non-commuting oper¬ 
ators from left to right in a ^-decreasing succession. The 
exponent of the ordered exponential contains function 
g'(x;h) = dg(x;h)/dh for x £ [0, X] and is not known 
when g{x\ h) is not know on the whole definition inter¬ 
val. This derivative can also be expressed via an ordered 
exponential 


g'(X, h) = Ta, exp 



+m(x)g'(x-, h + h)d^\ } g'(h + h ) 


h =0 


(18b) 


/ (?) Xi> mi, m 0 ; x(m)) = --(1 -q-X i) 2 


P 

4 L 


mi (q + Xi ) 2 - m 0 q 2 


P 


dm [q + Xq (m)Y 


~^(5i(m o,h + riy/q)) rl , (19) 


where we denoted Xo(m) = f™ dm' x(m'), 

— f i r mi 

gi{m 0 , h) = T m exp l - / dmx(m) [d\ 
l ^ J mo 


+mg[(m; h + h)d^\ } g\(h + h) 


. (20a) 


h =0 


and T m is now m increasing ordering. The input function 
is 


gi (h) = —- In [ d— e ^ / 2 [2 cosh (/3 (h 

mi J_ 00 V2t r 


+(^Vxi - X 0 (mi 


. (20b) 


This free energy better suits the case when the solution 
with a continuous RSB peels off from a solution with one- 
level RSB or the two solutions coexist. The space of the 
order parameters is restricted to an interval 0 < m\ < 1 
and 0 < X'o(m) < Xi < 1. 

If free energy fx is not locally stable and at least one of 
stability conditions, Eq. (16), is broken for all Af’s, it is a 
question whether the continuous limit K —> oo is locally 
stable. It can be shown that the continuous free energy 
f(q,X-,m(x)) is marginally stable, fulfills the continuous 
version of stability conditions with equalityPSI It means 
that the continuous free energy does not break ergodicity, 
is always marginally ergodic in the whole spin-glass phase 
as the ferromagnetic model is only at the critical point. 

Both continuous free energies, Eq. and ( fl9| ), were 
derived as the limit of the number of replica hierarchies 
K —> oo where the distance between the neighboring hi¬ 
erarchies is infinitesimal, that is A xi oc X -1 , as well as 
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Xk oc A' -1 , and Axi/Ami < oo for each l < K. Repre¬ 
sentation (19) is, however, more general, since it allows 
for a mixture of a discrete and continuous order param¬ 
eters. 


The continuous free energies were derived for the Ising 
spin glass but they can be straightforwardly generalized 
to other spin-glass models. The symmetry of the order 
parameters has to be adapted and the input sing le-site 
free energy g or g\ is to be appropriately modified. 16 1( 


V. EQUILIBRIUM STATES IN SPIN-GLASS 
MODELS: ASYMPTOTIC SOLUTIONS 


Spin-glass models experience a nontrivial ergodicity 
breaking that can be studied with hierarchical replica¬ 
tions. The replica method does not tell us, however, how 
the true equilibrium looks like. Whether finite number 
of replica hierarchies are enough to restore ergodicity or 
it is the marginally ergodic continuous limit that repre¬ 
sents the equilibrium state. The problem with the mean- 
field theories of spin glasses is that we are unable to find 
full solutions in most models beyond the first level of 
ergodicity breaking, 1RSB free energy, Eq. (15). The 
only way to resolve the stationarity equations of the full 
mean-field models is to use an asymptotic expansion in 
small order parameters below the transition point to the 
glassy phase, if they exist. That is, when the transition 
is continuous. We now discus the three spin-glass models 
defined in Sec. EU Each of the models shows a different 
behavior in the glassy phase. 


leading order of the order parameters 
AXl ~ 2K+1 6 ’ 


<1 K = 


2 K + 1 
1 * 


2K+1 


(21a) 

(21b) 

(21c) 


that clearly indicate that the limit K —> oo leads to the 
Parisi continuous replica-symmetry breaking. Since each 
solution with a finite number of replica generations is 
unstable 


\ K = - 
1 3 (2K + 1) 


2 < 0 , (21d) 


it is explicitly proved that the Parisi solution is the equi¬ 
librium state in the glassy phase of the Sherrington- 
Kirkpatrick model. Other physical quantities in the 
asymptotic limit are the Edwards-Anderson parameter 
defined as Q K = q + J2iLi 


Q K =e 

local spin susceptibility 


12 K(K + 1) + 1 q2 


3(2A' + l) 2 


(22a) 


K 


xt = P ( i - Q k + X] m i A xi ) = 1 - 


9 2 


;=i 




3(2A'+1) 2 ' 
(22b) 

and the free-energy difference to the paramagnetic state, 

4 


7 


29 


A/ = \-9 i + — 0 4 +- 9 b - 9 b — . (22c) 

J \ a Q/i ion / oan \ is 1 v / 


24 


120 


1 


360 


1 


K 


Differences between different levels of RSB manifest 
themselves in free energy first in fifth order. 


A. Ising spin glass 


Mean-held Ising spin glass is paradigm for the the¬ 
ory of spin glasses. It is called Sherrington-Kirkpatrick 
mo del P® It is this model for which Parisi derived 
a free energy with a continuous replica-symmetry 
breakingP2EHl jt was also later proved that the hierar¬ 
chical scheme of replica -symm etry breaking covers the 
exact equilibrium stateP^HSl The rigorous proof does 
not, however, tell us whether the equilibrium state 
is described only by a finite number of replica hi¬ 
erarchies or a continuous limit is needed. Only a 
few years ago we resolved the hierarchical free energy 
f K (q;Axi,...,AxK,mi,...,m K ) for arbitrary K via 
the asymptotic expansion below the transition temper¬ 
ature in a small parameter 9 = 1 — T/tJ^ 1 Only this 
asymptotic solution was able to resolve the question of 
the structure of the equilibrium state. We found the 


B. Potts glass 


The Potts model with p states reduces to Ising for 
p = 2, but differs from it for p > 2 in that it breaks 
the spin-reflection symmetry. This property was used to 
argue that the Parisi scheme failsP^It had been long be¬ 
lieved that it is the one-level replica-symmetry breaking 
that determines the equilibrium state below the transi¬ 
tion temperaturePS The Potts glass displays a discontin¬ 
uous transition into the replica-symmetry broken state 
for p > 4p3 Discontinuous transitions do not allow us to 
use an asymptotic expansion in a small parameter below 
the transition temperature. It is, nevertheless, possible 
to test the ordered phase of the Potts glass for 2 < p < 4. 
We did it in Refs. I16IZ51 and found an unexpected behav¬ 
ior. 

Studying the discrete replica-symmetry breaking we 
found two 1RSB solutions with the same geometric pa¬ 
rameter 


m = 


P~ 2 


36 - 12 p + p 2 
8(4 -p) 


(23) 


2 


















One non-trivial 1RSB solution then leads to order pa¬ 
rameters 


7 (1) = 0 


A X (1) 


2 g 228 - 9 6p + p 2 2 

A-p 6(4 — p) 3 


while the second one has both parameters nonzero 


A X (2) 


—12 + 24p — 7p 2 2 
3(4 — p) 2 {p — 2) ’ 

2 360 — 204p - 6p 2 + 13p 3 2 

4 — p 6(4 — p) 3 (p— 2) 


(24a) 

(24b) 


(25a) 

(25b) 


We can see that the asymptotic expansion with small 
parameters q and A\ breaks down already at p = 4 
above which we expect a discontinuous transition from 
the paramagnetic to a 1RSB state at To > T c = 1. 
Note that a transition to the replica-symmetric solution 
q > 0, A\ = 0 is continuous up to p = 6. 

The 1RSB solution has a higher free energy than the 
replica-symmetric one. The difference is of order 9 3 , 


flRSB 


(p~ 2) 2 (p- 1)6> 3 
3(4 -p) (6 -p) 2 


(26) 


The two stationary states of the 1RSB free energy behave 
differently as a function of parameter p. The former so¬ 
lution is physical for all values of p unlike the latter that 
becomes unphysical for p > p* « 2.82 where q^ from 
Eq. (25a I turns negative. It is also the region of the pa¬ 


rameter p where the first solution is locally stable as can 
be seen from the stability function 

M 0) = {7p2 ~ 24p+12) > 0 • (27) 


in this region. That is why the solution with q = 0 was 
assumed to be the true equilibrium and a solution with a 
continuous replica-symmetry breaking had not been ex¬ 
pected to exist. We, however, found that there is a Parisi- 
like solution even in the region of stability of the solution 
from Eq. (24). The second 1RSB solution is unstable 


and decays to solutions with higher numbers of replica 
hierarchies as 


„k 1 12 — 24p + 7p 2 q 2 


Q 3K 2 (4 — p) 2 (p — 2) 

Axf = 4 t 


K (4 — p) 


k ■ P 2 
m, = —-— 


4 — p 


3+^ P~P 


. „ „ 7 ,\ 21 — 1 

+ 1 3 " 6P+ 4 P ) ~2K~ 


(28a) 

(28b) 

(28c) 


We can see that the AT4SB solution behaves unphysi- 
cally in the same way as the second 1RSB solution does. 
The averaged square of the local magnetization is nega¬ 
tive for p > p* where the first 1RSB solution is locally 



FIG. 2: Entropy S (left scale, dashed line) and local stability 
A (right scale, solid line) of the 1RSB solution from Eq. (241 of 
the 3-state Potts glass. The solution becomes locally unstable 
at ss 0.33T C and entropy negative at T « 0.16T C . 


stable. Negativity of q means that local magnetizations 
are imaginary and the solution is unphysical. This de¬ 
ficiency, however, decreases with the increasing number 
of spin hierarchies and disappears in the limit K —> oo. 
It means that the resulting solution with a continuous 
replica-symmetry breaking shows no unphysical behav¬ 
ior. It is analogous to negativity of entropy in the low- 
temperature solutions of A'RSB approximations of the 
Sherrington-Kirkpatrick model. 

Potts glass hence shows a degeneracy for p* < p < 4 
with a marginally stable solution continuously break¬ 
ing the replica symmetry and a locally stable one-level 
replica-symmetry breaking. To decide which one is the 
true equilibrium state one has to compare free energies. 
The difference of the continuous free energy f c and that 
of the A'RSB solution is 


att , ^ (p-l)(;p(7p-24) + 12) 2 0 5 ^ 

Pile - Jkrsb) = - 720A' 4 (4 - pf - (29 ) 

and and that of the replica-symmetric one reads 


Off \ 0 3 — 1)(p — 2) 2 fl 3 

p{fc fRS) 3 (4 — p)( 6 — p) 2 


(29b) 


We see that the solution with the continuous RSB has the 
highest free energy as the true equilibrium state should 
have for geometric factors m < 1. In this situation en¬ 
tropy reaches minimum and free energy maximum in the 
phase space of the order parameters. The locally stable 
1RSB solution becomes unstable at lower temperatures 
and entropy turns negative at very low temperatures as 
demonstrated on the 3-state model in Fig. [2j This leads 
us to the conclusion that the Parisi solution with a con¬ 
tinuous replica-symmetry breaking represents the equi¬ 
librium state for the Potts glass with p < 4. 
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C. p -spin glass 

The spin model generalized to random interactions 
connecting p spins, p-spin glass has been used to simulate 
the dynamical transition in real glasses.^- 2 ' This model, 
analogously to the Potts glass, generalizes the Ising spin 
glass to p > 2 and allows one to study the behavior of 
the equilibrium state as a function of parameter p. In 
particular, the limit p —>■ oo is accessible 7 and is exactly 


solvable. It coincides with the random energy model of 
DerridaP^ For this reason the p-spin glass was also in¬ 
tended to be used to study and understand the genesis 
of the Parisi free energy when studying the asymptotic 
limit p —> oo. 

To cover both the boundary solutions p = 2 and p = oo 
we have to mix up the one-level RSB scheme and the 
Parisi continuous RSB. Such free energy density of the 
mean-field p-spin glass reads 


/t p) (9>xi,mi,mo;z(m)) = l 1 ~p(q + xi) + (p- !) (q + xi) p/(p 2) 


4 1 


p- 1 


Mi (q + Xi)) P/iP ~ 1) - ^q p/(p ~ 1) 


p-1 


dp[q + X o(m)F /(P 15 - (ffi (mo, h + g^pq/2^ ^ , (30) 


with 


temperature entropy in the 1RSB solution. We obtain 


gi(Pi,h) = T^exp 


dp x(p) [d\ 


+ pg[{p,h + h)d h ] >gi(h + h) 


, (31a) 


h =0 


where Xo(g) = dp'x(p')- The generating free energy 

is 


gi(h) = — In f ^ / 2 [2cosh ((3 (h 

Ml J —oo v27T 

+(/>VpU i - ^o(mi )/ 2 )) 1 


(31b) 


We rescaled the function m — > p = f3m. If M = p 0 , free 
energy reduces to the 1RSB approximation. On the 
other hand if = 0, or pi = /3 free energy /^ coincides 
with that of the Parisi solution with a continuous replica- 
symmetry breaking. 

The p-spin glass can not only be used to investigate 
analytically the p —> oo limit but also the T —> 0 limit. 
In this limit simple solutions of mean-field models lead 
to negative entropy. It is easy to calculate the zero- 


S 0 (h) oc - 


p(p - 1) 


ex p{—M iPXi/4} 


V^PX i 


exp{—h 2 /pxi} l 2 
2 CH^h) 

(32) 


where we used the following notation 
2 CH^h) = e^E^X-h) + e-^ lh Ejp\h) , 

-Piy/pXi/2) / 2 

Jh/^VX l/2 


(33a) 

(33b) 


Negativity of the low-temperature entropy indicates that 
1RSB cannot produce a stable ground state for arbitrary 
p < oo. Negativity of entropy decreases with increasing 
p, see Fig. pi but only if a condition p\p \l = oo is ful¬ 
filled the 1RSB solution (gi > 0) leads to zero entropy 
at zero temperature. Nonnegative entropy is a necessary 
condition for physical consistency of the low-temperature 
solution. It then means that the low-temperature equilib¬ 
rium state for p < oo must contain the Parisi continuous 
order-parameter function x(p) with /3 > pi > M > po- 
It can also be seen from the asymptotic free energy for 
p —> oo that reads 


fT^°°\q,Xi,Pi) = -tL I 1 ” (q + Xi) (1 -ln(g + xi))] - — ln[2cosh(/ii/i)] 

4 1 p l 

- Y [xi - (<? + Xi)ln(g + Xi)] - ^ [ln 9 +p(l -tanh 2 (/iih))] , (34) 


giving the leading-order solution for the variational pa- der one while the latter is exponentially small for large p, 
rameters Xi? Pi and q- The first two parameters are of or- 
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Xi = 1 - Q , (35a) 

q = exp{— p(l — tanh 1 2 3 4 5 6 (pih))} , (35b) 

/ii = 2\/ln[2cosh(^i/i)] — htanh(pih) . (35c) 


The above nontrivial solution holds only if 
/3 > 2-y/ln [2 cosli(/3/i)] — htanh(f3h) (low-temperature 
phase), otherwise = (3 and + Q = 0 (high- 

temperature phase). To derive an equation for the 
order-parameter function x{p) one needs to include the 
next-to-leading order contributions. To go beyond the 
leading asymptotic order one can use the Landau-type 
theory for the order-parameter function developed in 
Ref. [171 Note that the asymptotic solution from Eq. (35) 
with p(x) = 0 suffers from a negative entropy as can be 
seen from Eq. (32) and is plotted in Fig. [3j Note that 
the transition to the ordered phase in the p-spin glass 
is discontinuous and hence, an asymptotic expansion 
below the transition temperature is not applicable. Only 
an asymptotic expansion p —> oo makes sense. 


VI. CONCLUSIONS 

We studied ergodicity breaking that is not accompa¬ 
nied by any broken symmetry of the Hamiltonian. Equi¬ 
librium thermodynamics and the equilibrium cannot be 
found then by standard methods, since ergodicity can¬ 
not be straightforwardly restored. When no symmetry of 
the Hamiltonian is broken we do not have direct means, 
physical macroscopically controllable external fields, with 
which we could remove dependence of the thermody¬ 
namic limit on properties of the thermal bath. Broken 
ergodicity impedes the existence of a uniquely defined 
thermodynamic limit that depends on the behavior of 
the thermal bath. The system is not thermodynamically 
homogeneous. 

We used replications of the phase space of the dy¬ 
namical variables to simulate the impact of the thermal 


bath. We introduced a small inter-replica interaction and 
looked at the linear response to it. This scheme was hier¬ 
archically used to test and restore at least local thermo¬ 
dynamic homogeneity. The principal step in this proce¬ 
dure was to select an adequate symmetry-breaking of the 
replicated variables so that to make thermodynamic po¬ 
tentials analytic functions of the originally integer repli¬ 
cation index. Only then it is possible to test and restore 
thermodynamic homogeneity and ergodicity. 


We explicitly demonstrated this construction on mean- 
field models of spin glasses. Randomness in the spin- 
exchange in these models makes them frustrated and no 
regular long-range order is established in equilibrium. Er¬ 
godicity is broken in the whole low-temperature, spin- 
glass phase and the thermodynamic limit is not uniquely 
defined. Replica method allows one to restore ergodicity 
in hierarchical steps by breaking successively the replica 
symmetry or independence of the replicated spaces. 

We applied the real replicas on mean-field Ising, p- 
state Potts and p-spin glass models and calculated their 
asymptotic solutions below the transition temperature to 
the glassy phase. While the Ising spin glass is known to 
have continuously broken replica symmetry in the equi¬ 
librium state, the Potts and p-spin glasses allow for lo¬ 
cally stable solutions with a one-level discrete replica- 
symmetry breaking. The continuous RSB and 1RSB co¬ 
exist in the p-state Potts model, while the p-spin glass 
reduces to a 1RSB solution in the limit p —» oo. In both 
cases for p < oo the 1RSB state leads to negative en¬ 
tropy at very low temperatures and it seems that the 
ultimate equilibrium state for the mean-field spin-glass 
models breaks the replica symmetry in a continuos form 
as suggested by Parisi in the Ising model. Our analy¬ 
sis indicates that a continuous RSB is indispensable to 
prevent entropy to become negative at zero temperature. 
Spin reflection symmetry is hence not substantial for the 
existence of a solution with a continuous RSB. 
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